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ABSTRACT 

Research investigated the effect that the us 
simulation-geoing techniques have upon the acquisition and c 
retention of Eacts, concepts, and principles. Two*hundred an 
ninety-five students in public secondary schools in Indiana 
participated In the project; these were divided into experim 
control groups which received instruction in United States H 
The fomer eajloyed the simulation-GatBing techniqueis, the la 
lecture-discussion method Posttest results showed that both 
performed equally well with respect to cognitive achievement 
that students in the experimental group performed significan 
better on a delayed interval posttest measure of cognitive r 
It was thus concluded that the simulation-gaming techniques 
represented a pedagogical tool which significantly enhanced 
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Intrcxiuctlon 

The use of slmulatiorvsamlng techniques as attenpts to foster more • 
active student participation in the learning process has increased in 
recent years. Ihese techniques are still suspect > however, by many who hold 
the opinion that students' cognitive, achievement and retention suffer 
from their use. Therefore, the voalQ objectl'^e of this study was to endeayor 
to compare the effect of the use of simulation-gaming techniques with that 
of lecture-discussion techniques on students* cogiitive achievCTient and ' 
retention of facts, concepts and principles. 

Other researchers have examined the effect of sinuLat ion-gaming on 
cogiitive achievement and/or retention with mixed results. Baker (1968), 
In a study involving eighth grade U.S. History students, conpared the 
effects of the ase of simulation with the use of the textbook-discussion 
approach. He concluded that simulation was more efficient than the textbook- 
discussion approach as a method of teaching historical facts, concepts 
and attitudes to Junior high school students. 

A study by McKenney and Dill (I966) Investigated the U£?e of simula- 
tion in the ^BA curriculum at the Harvard Business School. Iheir findlrigs 
indicated that wore Ijiportant than the use of slmalation was the emphasis 
faculty members gave to topics of study when cogiitive retentior^wa^^ the 
goal of instruction. 

Garvey and Seller (1966)'^studled the effectiveness of different 
methods of teaching international relations to hi^ school students, in- 
cluding the use of simulation. In their study, students exposed to the use 
of slmilatlon did not score as well as control group students in terms of 



cognitive achievement at the end of the experljmental period, and sll^tly, 
but not significantly, higher following a delayed Interval testing eight 
weeks later • 

Examining the effectiveness of the simulation-game in teaching spe- 
cifically defined behaviors i^lated to consumer credit, Afiderson (1970), 
confpared slinulatlon-gaming with conventional classroom techniques using 
as subjects two hundred-eighty hlf^ school seniors in one school. His 
findings suggest that slmulation-gamlng was as effective as the conventional 
classroom approach in producing the desired results. 

Heinkel (1970), compared the use of simulation-gaming with lecture- 
discussion in a study involving sixty-seven Junior college political science 
students. He reported no si^ilflcaxit differences in co^iitive learning 
when the two methods were conpared. In his Judgement, the criticism that 
students do not learn as much through simulation as through other meaiis 
was not supported by his study. On the othei* hand, Wentworth and Lewis 
(1973) found that Junior college students exposed to simulation in ano 
Introductory course in economics scored significantly lower on a measure of 
cognitive achievement when conpared with students not r^xposed to simulation. 

Cherryholmes (1966), in a review of research on the effectiveness of 
educational simulations, observed that there was little evidence to sup- 
port the claim that simulation participants will learn more facts and 
content principles than will students learning by more traditional means. 

Noted during the review of the literature cited were a nuirbar of 
weaknesses in research design. Among them were: 1) use of relatively 
untried games 6f the researchers 'Resigns, 2) small samples of subjects, 
3) use of dependent measures of AAj^termined reliability, k) little attenpt 
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to contrpl for the teacher variable, 5) relatively short periods of experi- 
mental treatment, and 6) restriction of experimental treatinent to one type of 
geogt-aphlcal and social environment ♦ 

Believing that the problem merited further study and that weaknesses 
noted in the earlier research could be minimized in a more rigorous research 
design, the investigators postulated laid examined the following null 
hypotheses for purposes of this study: 

1. At the conclusion of a five week (25 classroom hours) experi- 
mental treatment period, there will be no significant difference 
between the control group (lecture-discussion foimat) and the 
experimental group (simulation-gaming foimat) on a measure of 
cognitive achievement. 

2. Following a delayed interval of ten weeks, after the conclusion 
of the experimental period, there will be no si0iifJ.cant dif- 
ference between the control and experlinental groups on a measure 
of cognitive retention. 

Methodolog y . 

The experimental treatment period consisted of five weeks (25 class- 
room hours) during which the control group studied United States Domestic 
History (I87&-1915) by means of the traditional lecture-discussion format 
while the experimental group studied Identical material by means of ^Jmu- 
lation-gamlng techniques. 

dhe subjects in the study wei^e students enrxDlled in twelve intact 
United States History classrooms in five public high schools located in 
three different types of geographical and social environments in IndlarAa. 
Six classes each were randonly assigned to the control and experimental 
groups . 



l\*o huTKiiyl ninety-four students participated in the study . These 
students, for whom the mean I.Q. was 106, were grouped as general ability 
students* One hundred fifty-eig)it students were females, while the males 
numbered 136 • One hundred forty-two students were enrolled in the six 
control classes, and 152 were enrolled in the six experimental classes. 

In order to obtain a geographically and socially diverse mix in the 
student sanple, three different school populations were selected • Pour 
classes were selected from an envJ.ronment categorized as rural-small town# 
Fbur classes were selected from an environment categDrized as medium sJ.ze 
city, that Is they lived in a city with a population of 85,000. The retain- 
ing four classes were located in a city of more than 170,000, 

To control for the teacher variable, each of the six volunteer teachers 
participating in the study tau^t one bontrol and one experimental class. 
Prior to the beginning of the experimental treatment period, each teacher 
received instruction in the use of the three- simulation-games. The instruction 
included working through the procedures for playing the games, the goals of 
each simulation exercise, and the utilization of debriefing sessions at the 
conclusion of each simulation. 

Three com:nercially available simulation-games were utiliz^ed in the 
experimental classes. They were: "The Game of Panning," High School 
Qeographiy Project: Manufacturing and Agriculture ^ published by the MacMillan 
Co. in 1969 J "Promotion," /jnerican His t ory Games published by Abt Associates, 
iTiC. in 1970 ; and The Cities Game published by Communications, Research, 
Machines, Inc* in 1970* 

The teachers were instructed to assigi the students in the experimental 
and control classes the normal textbook readings. The lectures in the 
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control olasses were derived frOTi readings aiKi textbook material • Ihe 
procedure was the pattern for the control classes during the five weeks , 
Ihe experlinental classes spent the entire period using the three simulation- 
gaines and debriefing them. Following the conclusion of the experimental 
period of five weeks > each teacher was instructed to utilize the 
slmilation-gamlng techniques, but to return to their normal classroom 
instructional procedures during the ten week delayed interval. 

A forty-four ftem instrument was developed to be used as a measure of 
cognitive achievementr-retention. Following a pilot study using the measure, 
fourteen ito^ns were found non-reliable and deleted from the instrument, IVie 
remaining thirty items, for which a reliability factor of .79^2 or greater 
was obtained, were deemed usable for the study. A panel of three Laboratory 
School social studies faculty Judged the content of the measure to be valid. 
Uie measure was administered as a pre-, post- and delayed interval post-test. 

Statistical analysis of the data was obtained by the use of the "Uni- 
variate and Multivariate Analysis of Variance and Covarlance,^' a prepared 
program developed at the State Uni.verslty of New York at Buffalo. Pre-test 
scores and I.Q. scores were enrployed as covarlates in attenpts to control 
for possible differences in pre-treatment funds of knowledge held by 
students and in intellectual abilities. 
Findings 

As can be seen in Table 1, the differences between the control and 

TABI£ 1 

ADJUSTED MEAN SCORES ON POST-TEST MEASURE 
OP COGNITIVE ACHIEVHWr 
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Control 


P 


M 


Confined 


"16.78 


15.68 


16.23 



Experimental 


P 


M 


Combined 


16.15 


I6.k3 


16.29 



experimental groups on the post-test measure of cognitive achievement were 
negligible. Tt\e adjusted mean scores for boys and girls alike in both the 
experimental and control groups reflect a correct response for about 
sixteen out of the thirty items. 

IVie analysis of covariance for the data, as reported in Tfeible 2, 
revealed no significant differences between the experimental and control 
groups for the variables of treatment and sex or for the interactions 



TABLE 2 

ANALYSIS OP COVARIANCE TABLE SHOWINO WE RESULTS OBTAINED 
ON THE POST-TEST: COGNITIVE ACHIEVENENT mWJMEMT 



Source 


SS 


DP 


MS 


P 


P 


Treatment 


0.0661 


1 , 


0.0061 


0.0005 




Sex 


0.7219 


1 


0.7219 


0.0583 


O.8O95 


Teacher 


233.1900 


5 


^16.6380 


3.7648 


0.0027* 


Sex by 












Treatment 


O.O6O3 


1 


O.O603 


0.00^9 


0.9445 


Sex by 












Teacher 


83.9895 


5 


16.7979 


1.3560 


0.2417 


Treatment by 












Teacher 


179.5825 


5 


35.9165 


2.8993 


0.0147* 


Sex by Treatment 










by Teacher 


29.2630 


5 


5.8522 


0.4724 


0.7967 


Error 


2923.568 


236 


12.388 


•Significant at 


.05 level 


or beyond. 









of sex by treatment, sex by teacher and sex by treatment by teacher. 

1h(ire v^as a significant difference between the two groups for the variable 
teacher. Ihe control group atudents of two teachers perfomed better on a 
measure of cognitive Achievement than did the experimental group students of 
the same teachers. On the other hand, the experimental group students of four 
teachers perfonned better on the measure of cognitive achievement than did 
their control group students* . 

m' addition, the data reflect the fact that the interaction, treatment by 
teacher was significant. That is, teachers* efforts were narked by diffeiv 
ential results according to whether they were using the experimental or 
cont3?6l gjx>iq? mode of instruction. ' 
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Ten weeks following the post-test measure, the same instrument was 
administered as a delayed interval measure of cognitive retention. IVie ad- 
Justed mean scores for that administration of the instrument appear in 
Table 3. 

TABI£ 3 

ADJUSTED ^EAN SCORES ON' DELAYED IWTERVAL POST-TEST 
MEASURE OF C0GN3?riVE RETENTION 



Control 




P 


M 


Combined 


15.31 


14.53 


14.84 



Experimental 


F • 


M 


Coirblned 


18.92 


18.50 


18.71 



\ 

In this instance, the difference between the control and experijnental groups^ 

was more noticeable. A spread of almost four more correct items for the e^ri- 

mental group than for the control group was evident. Ihis difference, favoring 

the experJjrental group, was significant as is indicated by the data for the 

treatment variable given In Table 4. 

TABLE 4 

ANALYSIS OF COVARIANCE TAH£ SHOWING THE. RESULTS OBTAINED ON THE 

Delayed INTERVAL POST-TE^^ cognitive retention instoument 



J 


Source 


SS 


DF 


MS 


P 


P 


Treatment 
Sex 

Teacher 


949.370?i 
11.4844 

328. 1705 


1 
1 
5 


949.3708 
11.4844 
65.6357 


63.2476 
0.7651 
4.3727 


" O.OOOl* 
0.3826 
0.0008* 


Sex by 
Treatment 


0.0059 


1 


0.0059 


0.0004 


0.9843 


Sex by 

Teacher 170.7250 
Treatment by 

Teacher 97.1270 
Sex by Treatment 

by Teacher 62.7690 
Rr>ror 3542.360 


5 
5 
5 

236 


34.1450 

19.4254 

12.5538 
15.010 


2.2748 
1.2941 
0.8363 


0.0480* 

0.2671 

0.5250 

* 


"Significant at .05 level or beyona 


• 
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The data for the variable, treatment indicated a significant difference 
between the experlinental and control groups on the delayed interval measure 
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of cogiitlve retention. Evident, too, was a slgilflcant difference for the 
variable, teacher. Ihe interaction, sex by teacher was also significant. 

Students in the experimental groups of all teachers performed better 
on the delayed interval measure than did their control group counterparts. 
However, the students of different teachers perfon:ied differentially ♦ Thus, 
there were significant differences associated with the teacher variable for 
both the post-test and delayed interval post-test measures. 

While the sex by teacher interaction was found significant, no in- 
terpretation of the finding will be given here since its source and meaning 
have not been studied by the investigators. 
Conclusions 

According to the data presented in Table 2 and Table 4, and congruent 
with the null hypotheses presented earlier, the following conclusions seem 
warranted: 

1. Students in United States History classes who are exposed to 
simulation-gaming techniques perfonn as well on a measure of 
cogiitive achievement administered at the conclusion of the 
experlinentail treatment period as do students who are exposed to 
traditional lecture-discussion techniques. 

2. Students in United States History classes v^o are e^^xjsed to simu- 
lation-gaming techniques perfonn significantly better on a delayed 
Interval post-test measure of cognitive retention than do students 

^ in United States History classes exposed to traditional lecture- 
discussion techniques* 
Discussion 

— - — — / 



In the world of twentieth^j^atitury American education, serious questions 
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have been asked concerning what is worth knowing and vrtiat is needed foi* 
living an effective life. Teachers in elementary, secondary and college 
classrooms ft?equently raise these questions. Their students participate in 
a dynamic society, one charged with emotion, physical action and imagination. 
However, many courses of study in the schools place errphasis on abstract and 
relatively passive learning processes, allowing students few opportunities 
for active participation in the learning process. Ihis enphasis has created 
a high degree of frustration among students v/ho feel the need for active 
participation in the learning process and in societal affairs. 

The use of sljitulation-gamlng as a teaching tool has become of increasing 
irrportarice to teachers, and social and behavioral scientists. Many pducatora 
believe that simulation-gaming techniques provide feasible alternatives to 
the abstractness of traditional lecture-discussion techniques. The data 
obtained in this study tend to support the views of those educators who are 
of the opinion that a more active participdtion by students in the learning 
process is Indeed a feasible alternative to the lecture-discussion peda- 
gogical mode. 

While the conclusion that students exposed to slmulatiorv-g^mlng tech- 
niques perfom as well on a measure of cognitive achievement as do students 
exposed to traditional lecture-discussion methods of instruction seems well ^ 
founded, the conclusion that they perfom superiorally on a measure of 
cognitive retention must be tendered by the finding that the students in 
the experljnental group in this study scored higher on the de].ayed interval 
post-test than they did on the post-test administered at the conclusion of 
the experiinental period. This flMlng reflects an educationally desirable 
outcome, but a statistically disconcerting one. It would normally be 
expected that forgetting would have taken its toll and that the adjusted 
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means would have been lower. . Ihis was not the case. To what should the 
Increase then be attributed? 

Post-experimental contact w?.th the participating teachers revealed that 
they reported discontinuing the experimental mode of instruction at the 
conclusion of the experimental period as they had been instructed to do. 
Speculation, then, leads us to the Interpi'etation that students in the 
experimental 0:x>ups mi^t have become so involved in the active process of 
learning that they continued to reinforce what they had learned and, indeed, 
to continue learning, either individually or^llectively, during the delayed 
interval period. 

The conclusions derived from this study, then, suggest that slmulation- 
j^imlng is a pedogoglcal tool which enhances the learning of those exposed 
to it when it is conpared with traditional lecture-discussion techniques. 



ERIC 



REFERENCES 



Anderson, Raymond. "An Experlinent on Behavioral Learning in a Consumer 
Credit Game." Sirmdatlon and Games; An International Journal of 
I heory, Design, and Research , I, No. 1 (March, 1970). ^3-5^. " 

Baker, Eugene H. "A Pre-ClvJ.l War Simulation for Teaching American History," 
in Simulation Games in Learning . Edited by Sarane S . Boocock and 
E.O. Schild. Beverly Hills: Sage Publications, Inc., 1968. 

Cherryholmes , Cleo H. "Some Current Research on Effectiveness of Educational 
Simulations: Inplicatlons for Alternative Strategies." American^ 
Behavioral Scientist , X (October, 1966), 3-'^. 

GaiTvey, Dale M. and Seller, William H. A Study of Effectiveness of _Dlfferent 
Metho^ ts of ^Teaching International Relations to High School Students . 
Eiipbrial Kansas State Teachers Ctollege, 19bb. 

Heinkel, Otto A. "Evaluation of Simulation as a TeachJjig Device." Hie 
Joun^ of Experimental Education . XXXVIII, 3 (Spring, 1970), 3^6. 

McKenney, James L. and Dill, William R. "Influences on Learning in Simulation 
Games." American Behavioral Scientist , X (October, 1966), 28-j2. 

' Wentworth, Donald R. and Lewis, Darrell R, "A-'^vie^^of Research on Insti- 
tutional Games and Simulation In Socied /studies ^ucatlon." Social 
Education , XXXVII (May, 1973), k32'HkO,\^ ) ' 



